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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
08/20/2008 has been entered. 

Response to Arguments 

2. Applicant's arguments filed 08/20/2008 have been fully considered but they are 
not persuasive. However, in view of the amended claims, all previous prior art, with the 
exception of Ehsani et al. US 20020032564 A1 (hereinafter Ehsani), pursuant to all 
previous office actions has been withdrawn. 

Argument 1 (page 5 paragraph 1): 

• "the present invention concerns a method for creating a speech 
recognition application callflow in which if the user combines pre-built 
grammars and any new options, the system searches the pre-built 
grammars for any matches to the new options, searching both valid 
utterances and associated annotations. If the new option exists in the pre- 
build grammar, the "new" option simply points to the equivalent grammar 
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entry. Otherwise, the new option becomes part of a grammar 
automatically built to hold it, with the entry in the new grammar having the 
text of the new option as both the recognition string and an associated 
annotation." 
Response to argument 1 : 

Examiner takes the position that Ehsani et al. US 20020032564 A1 (hereinafter 
Ehsani) in view of Washio US 200301 95739 A1 (hereinafter Washio) in fact 
teach the amended limitations. Ehsani teaches a system that consists of the 
following components: (a) a graphical user interface for designing and editing the 
call flow for a voice application , (b) a network expander that retrieves alternative 
variants for the user commands specified in the call-flow design from the 
database along with their probabilities, (c) a linguistic database, (d) an editor , and 
(e) a compiler that translates the grammar network into a format than can be 
used by commercial speech recognizers. Call Flow Design : The first step in 
designing a recognition network for a voice-controlled dialogue system consists 
of specifying the call flow in such a way as to anticipate the logic of the 
interaction. Th e system's graphical user interface allows the designer to specify 
user requests, system states, and the transitions between these states ([0221 - 
0222]). 



Further, Ehsani teaches the ability to handle annotations and sentences/phrases, 
where in addition to the phrase entries, the database comprises a vocabulary of 
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lexical items containing objects, locations, proper names, dates, times , etc. that 
are used to fill the slots in phrase templates such as "how do I get to . . .?" 
([0047]). 

Furthermore, Ehsani teaches that t he user responses in the call flow design are 
automatically expanded into recognition grammars. A grammar includes the set 
of user responses to system prompts that the system can recognize and process 
accordingly . FIG. 5 shows the type of network that needs to be generated to 
recognize the user response to the systems prompt "What kind of food do you 
like to eat?" For each user request, the grammar specifies the set of legitimate 
variants and supplies an abstract meaning representation (e.g., "request 
restaurant information") ([0223]). 

Additionally, Ehsani teaches that like the grammar design tool, the system 
provides a graphical interface for call-flow design and a large database of 
phrases for enabling the grammars to handle natural variations of user input , 
e.g., different ways of phrasing a request for information ([0236]). 

Ehsani also teaches a grammar designer that provides editing functionality at all 
stages in the design process. Initial call flow designs can be saved, retrieved, 
and changed in both graphical and text mode . After the network has been 
expanded, the designer can go back to the initial call flow design and edit the 
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phrase variants retrieved by the system . At this stage, most of the editing activity 
will consist of eliminating variants that don't fit the pragmatic context, and of 
completing phrase templates by accessing the supplemental databases provided 
by the system or by typing in the template fillers directly. The editor also permits 
review and modification of the meaning representations automatically supplied by 
the system (f0226l). 

However, Washio has been introduced to strengthen the teachings of Ehsani in 
order to add new grammar to speech recognition system when a system can not 
match an input grammar. 

Washio teaches that upon receiving the instruction signal for updating the 
grammar data, the grammar adding and updating part 23 matches the grammar 
data obtained in the grammar obtaining part 26 with the new-recognition result in 
the speech newly-recognizing part 21 , and determines an unmatched portion as 
an update portion of the grammar data . Then, the grammar adding and updating 
part 23 complements the grammar data with the update portion so as to update 
the grammar data , thereby outputting the updated grammar data to the updated 
grammar recording part 31 (Washio [0048] & Fig. 1). 



Further, Washio teaches a similar process, wherein a grammar update system 2 
of the present embodiment includes a speech newly-recognizing part 21 for 
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obtaining speech data and the like in the IVR system 1 , and recognizing the 
speech data without using the grammar data stored in the update original 
grammar recording part 15 , a new-recognition result determining part 22 for 
determining whether or not the new-recognition result is acceptable using the 
grammar data stored in the update original grammar recording part 15, and a 
grammar adding and updating part 23 for specifying an update portion and 
adding it to the grammar data so as to update the data (Washio [0038]). 

Furthermore, Washio teaches in other words that in the case where it is 
determined that the new-recognition result cannot be accepted based on the 
grammar data, the grammar adding and updating part 23 specifies such an 
unaccepted portion as an update portion, and adds the update portion to the, 
grammar data stored in the update original grammar recording part 1 5 so as to 
update the data (Washio [0041]). 

Claim Objections 

3. Claim 1 is objected to because of the following informalities: Examiner would like 
to point out the minor grammatical error, "individual option as an grammar (4th limitation 
of claim 1 ). Examiner construes "individual option as an grammar" as "individual option 
as a grammar". Appropriate correction is required. 
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Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 21 -23 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Ehsani et al. US 20020032564 A1 (hereinafter Ehsani) in view of Washio US 
20030195739 A1 (hereinafter Washio). 

Re claim 21 , Ehsani teaches a method for creating speech recognition 
application callflow ([0221-0222]), comprising the steps of: 

placing a prompt into a workspace ([0223]) of a graphical user interface for 
creating the speech recognition application callflow ([0221-0222]); 

assigning an individual option and a pre-built grammar to the same prompt 
([0226]); 

if the individual option is a potential valid match to a recognition phrase or an 
annotation ([0047]) in the pre-built grammar, 

However, Ehsani fails to teach treating the individual option as a valid output of 
the pre-built grammar; and 

if the individual option fails to be a potential valid match to the recognition phrase 
or the annotation in the pre-built grammar, treating the individual option as an grammar 
independent from the pre-built grammar. 
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Washio teaches that upon receiving the instruction signal for updating the 
grammar data, the grammar adding and updating part 23 matches the grammar data 
obtained in the grammar obtaining part 26 with the new-recognition result in the speech 
newly-recognizing part 21, and determines an unmatched portion as an update portion 
of the grammar data. Then, the grammar adding and updating part 23 complements the 
grammar data with the update portion so as to update the grammar data, thereby 
outputting the updated grammar data to the updated grammar recording part 31 
(Washio [0048] & Fig. 1). 

Further, Washio teaches a similar process, wherein a grammar update system 2 
of the present embodiment includes a speech newly-recognizing part 21 for obtaining 
speech data and the like in the IVR system 1, and recognizing the speech data without 
using the grammar data stored in the update original grammar recording part 15, a new- 
recognition result determining part 22 for determining whether or not the new- 
recognition result is acceptable using the grammar data stored in the update original 
grammar recording part 15, and a grammar adding and updating part 23 for specifying 
an update portion and adding it to the grammar data so as to update the data (Washio 
[0038]). 

Furthermore, Washio teaches in other words that in the case where it is 
determined that the new-recognition result cannot be accepted based on the grammar 
data, the grammar adding and updating part 23 specifies such an unaccepted portion as 
an update portion, and adds the update portion to the, grammar data stored in the 
update original grammar recording part 15 so as to update the data (Washio [0041]). 
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Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Ehsani to incorporate treating the individual 
option as a valid output of the pre-built grammar and if the individual option fails to be a 
potential valid match to the recognition phrase or the annotation in the pre-built 
grammar, treating the individual option as an grammar independent from the pre-built 
grammar as taught by Washio to allow for recognizing the speech data without using 
the grammar data stored in the update original grammar recording part, wherein the 
new-recognition result determining part determines whether or not the new-recognition 
result is acceptable using the grammar data stored in the update original grammar 
recording part, and the grammar adding and updating part for specifying an update 
portion and adding it to the grammar data actually updates the output data (Washio 
[0048] & Fig. 1). 

Re claim 22, Ehsani teaches the method of Claim 21 , wherein the pre-built 
grammar ([0233], expanding grammars) is selected from a list of pre-built grammars 
([0024], plurality of grammars). 

Re claim 23, Ehsani fails to teach the method of Claim 22, wherein the individual 
option is compared with each grammar in the list of pre-built grammars and if there is a 
match, the individual option points to the matching grammar and if there is no match, 
the individual option becomes a new grammar. 
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Washio teaches that upon receiving the instruction signal for updating the 
grammar data, the grammar adding and updating part 23 matches the grammar data 
obtained in the grammar obtaining part 26 with the new-recognition result in the speech 
newly-recognizing part 21, and determines an unmatched portion as an update portion 
of the grammar data. Then, the grammar adding and updating part 23 complements the 
grammar data with the update portion so as to update the grammar data, thereby 
outputting the updated grammar data to the updated grammar recording part 31 
(Washio [0048] & Fig. 1). 

Further, Washio teaches a similar process, wherein a grammar update system 2 
of the present embodiment includes a speech newly-recognizing part 21 for obtaining 
speech data and the like in the IVR system 1, and recognizing the speech data without 
using the grammar data stored in the update original grammar recording part 15, a new- 
recognition result determining part 22 for determining whether or not the new- 
recognition result is acceptable using the grammar data stored in the update original 
grammar recording part 15, and a grammar adding and updating part 23 for specifying 
an update portion and adding it to the grammar data so as to update the data (Washio 
[0038]). 

Furthermore, Washio teaches in other words that in the case where it is 
determined that the new-recognition result cannot be accepted based on the grammar 
data, the grammar adding and updating part 23 specifies such an unaccepted portion as 
an update portion, and adds the update portion to the, grammar data stored in the 
update original grammar recording part 15 so as to update the data (Washio [0041]). 
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Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Ehsani to incorporate the individual option 
is compared with each grammar in the list of pre-built grammars and if there is a match, 
the individual option points to the matching grammar and if there is no match, the 
individual option becomes a new grammar as taught by Washio to allow for recognizing 
the speech data without using the grammar data stored in the update original grammar 
recording part, wherein the new-recognition result determining part determines whether 
or not the new-recognition result is acceptable using the grammar data stored in the 
update original grammar recording part, and the grammar adding and updating part for 
specifying an update portion and adding it to the grammar data actually updates the 
output data (Washio [0048] & Fig. 1 ). 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Michael C. Colucci whose telephone number is (571)- 
270-1847. The examiner can normally be reached on 9:30 am - 6:00 pm, Monday- 
Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (571)-272-7602. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 



Application/Control Number: 10/726,102 Page 12 

Art Unit: 2626 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
/Richemond Dorvil/ 

Supervisory Patent Examiner, Art Unit 2626 

/Michael C Colucci/ 
Examiner, Art Unit 2626 
Patent Examiner 
AU 2626 
(571)-270-1847 
MichaeLColucci@uspto.gov 



